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Abstract 

New information on the structure of the nucleon from the HERA ep collider 
leads to higher neutrino cross sections for the processes v^ip^) + N — > fi~(fi + ) + X 
needed to calculate the expected rates of astrophysical neutrino induced muons in 
large detectors either under construction, or in the design stage. These higher cross 
sections lead to higher muon rates for arrival angles where neutrino attenuation in 
the earth is less important. On the other hand, new estimates of AGN neutrino 
fluxes suggest that the expected muon rates in these detectors may be much lower 
than previously calculated. I use the new cross sections to calculate the expected 
muon rates and angular distributions in large detectors for a variety of AGN models 
and compare these rates with the atmospheric neutrino backrounds (from both 
conventional decay channels and the 'prompt' charmed meson decay channels). If 
the lowest flux estimates are correct, there may be diffculties in determining the 
origin of a small excess of muons, due to the large uncertainty in the rate of the 
charmed meson neutrino production channel. However, the more optimistic AGN 
neutrino fluxes should be detectable in proposed detectors, such as DUMAND-II, 
AMANDA, NESTOR and Lake Baikal. 
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1 Introduction 



In this paper I consider the problem of detecting neutrinos from active 
galactic nuclei (AGN). Recent predictions (see for example |l]f|,§,!|,||) of the 
diffuse background of neutrinos from the sum of all AGN are high enough that 
water and ice Cerenkov detectors under construction such as DUMAND ||, 
AMANDA 0, Lake Baikal § and NESTOR § should be sensitive to muons 
from the interactions of the neutrinos in the earth [p~0| JTT] , p~^ r p~3| JT^ , p~5| JT6[1 . Most 
recently, Protheroe [J7|] has used a new model to calculate the rate of gamma 
ray and neutrino production in AGN jets. The resulting diffuse neutrino back- 
ground varies over many orders of magnitude depending upon assumptions 
made about the relative contributions of various production mechanisms in 
the AGN system. The minimum estimated flux may be beyond the reach 
of the current generation of neutrino detectors mentioned above. I have re- 
assessed the detectability of a wide range of flux predictions using calculations 
of the neutrino cross sections based on nucleon structure function parameter- 
izations p8|JT9| (parton distributions) derived from recent accelerator experi- 
J23|. Use of the new parton distributions leads to higher cross 
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sections and a corresponding increased probability of a detectable muon be- 
ing produced in the rock surrounding a detector. However, increased neutrino 
absorption in the earth is an important effect and offsets some of the gains for 
the longest neutrino paths through the earth. I present the rates and angular 
distributions of muons for different AGN spectra and for the flux of atmo- 
spheric neutrinos [^4| produced when cosmic rays interact with the earth's 
atmosphere, including neutrinos from charmed meson decay P"5| . [T"1| . |2"d'| . 



The outline of the paper is as follows. A brief review of the quark parton 
model and how it is used to calculate neutrino cross sections using accelerator 
structure function data (parton distributions) is presented. I then examine two 
of the most recent sets of parton distributions and look at the implications 
for the total cross sections. Finally, I discuss the use of these cross sections 
to estimate the rates and angular distributions of neutrino induced muons in 
large detectors, using a Monte Carlo simulation of the passage of neutrinos 
through the earth. This has the advantage of allowing a precise treatment of 
the effects of neutral current scattering, which reduces the neutrino energies 
before they finally interact to produce muons. The prospects for detection of 
the AGN fluxes above the atmospheric backgrounds are then examined. 

Upon completion of these calculations, I learned of similar work by 
Gandhi, Quigg, Reno and Sarcevic [16|, using another recent set of parton 



distributions [2o] , which yield muon rates consistent with the results presented 
in this work. 
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2 Quark-parton model and the neutrino cross sections 



2. 1 Parton model description of charged and neutral current neutrino cross 
sections 



The interaction of a neutrino with a nucleon may be described P7|j2q] in 
terms of the quark-parton model. The nucleon is considered to be a collection 
of quasi-free "partons" (quarks and gluons) which share the nucleon momen- 
tum. A proton consists of three valence quarks (up, up and down) surrounded 
by a sea of quark/antiquark pairs of all flavours. The description of a weak 
interaction of a neutrino (energy E u ) with a nucleon (mass M^) in the quark- 
parton model is described in terms of an interaction of the neutrino with any 
one of the individual quarks (which carries a fraction x of the nucleon mo- 
mentum). In a charged current process a W boson is exchanged from a muon- 
neutrino to the quark with the neutrino turning into a muon (energy E^). A 
neutral current process involves the exchange of a Z boson, with the neutrino 
remaining a neutrino. The square of the 4-momentum transfer is denoted Q 2 
and the variable y = vjE v [v = E v — Ey) describes the fractional energy trans- 
fer. The cross section for the inclusive processes Vpip^) + N — > + X 
and Vpipp) + N — > v^iv^) + X can be written in terms of the variables x 
and y = vjE v (referred to as Bjorken scaling variables) where x,y and Q 2 are 
related to the square of the centre of mass energy s = 2M N E V , by Q 2 = sxy. 

The cross section for the charged current interaction v^ipp) + N — > 
+ X is written in terms of three structure functions p^ N ^ uN ^p^ N ' yN 
and F^ N ' uN ) but if the transverse momentum carried by the quarks in the 
nucleon is negligible then the relation 2xEi = E 2 pSj reduces this dependence 
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The ± sign corresponds to the vjv cross sections. M\y is the mass of the 
W-boson and G F (= 1.16639 x 1(T 5 GeV" 2 ) is the Fermi constant 0. The 
cross section in equation p] is expressed in natural units where h — c — 1 
yielding a result in units of GeV -2 , to convert to a cross section in cm 2 we 
multiply by 0.38939 x 10~ 27 cm 2 GeV 2 £|. Equation | also holds for u e (p e ) 
e+(e-). 

The structure functions F 2 and F 3 are defined in terms of quark distri- 
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F 2 = x {q + q) 

(2) 



and 



Ff> m = q-q±2{[ S -c} + [b-t}} (3) 
where 

q=u+d+s+c+b+t 

q = u + d + s + c + b + i (4) 

are the sums of the quark/ ant iquark distributions (u,d,s, etc). Each quark 
distribution is a function of x and Q 2 describing the number of quarks of that 
flavour having a fractional momentum in the range x — > x + dx, at momentum 
scale Q 2 . Note that the ± sign again corresponds to the vjv cross sections. 

The neutral current cross sections z/^(z/^)+iV — > u^u^+X are expressed 
in the same form as equation but with Mjy replaced by Mz and the structure 



functions F 2 and F 3 written as p3] 



F 2 = x(q + q)[6l + 6 2 2 + 6 2 3 +6 2 4 ] 

+ 2x[(c -s) + (t- b)} [51 + 51 - 5\ - 5 2 A } (5) 

and 

F, = {q-q)[5l + 5 2 2 - 5l-5 2 A } (6) 

The 5 factors are the chiral couplings, defined in terms of the weak mixing 
parameter xw = sin 2 9 = 0.225 



d 1 ----x w 

1 1 

5 2 = -- + -x w 

r 2 

5 4 =ixH/ (7) 
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2.2 Parton distributions derived from recent accelerator data 



For this work the cross sections have been calculated using sets of parton 



distributions []lq , |19f fitted to the latest HERA deep inelastic scattering data 
[2"0",|2"T,2"2"|,2"3|. The HI and ZEUS collaborations have extracted the electromag- 
netic structure function F% p from collisions of 26.7 GeV electrons with 820 GeV 
protons. -F 2 ep is the sum of the individual parton distributions weighted by the 
squares of their electric charges : 

F? = ^(u + u)+ 1 -(d + d) + ^c + c) + 1 -(s + s)+ 1 -(b + b) (8) 



From the -F 2 ep measurement the individual quark distributions can be calcu- 
lated and used to form the structure functions F% N and Fa needed for the 
neutrino nucleon cross section calculation. However, to calculate the cross sec- 
tion in the energy range 10 5 — 10 8 GeV, we need to know the parton distribu- 
tions at higher Q 2 than the HERA measurements. QCD theory [|T7|, |3£|]5^ , |3m 
describes the evolution of the parton distributions to higher Q 2 . I consider 
two different solutions of the evolution equations, which predict sufficiently 
different behaviour in the unknown regions of Q 2 and x to give neutrino cross 
sections up to a factor of two bigger than previous calculations |3^ , |35|j36[| in 
the energy range of interest. Martin, Roberts and Stirling have presented sev- 



eral sets of parton distributions [41,|42,[43| based on the increasing amount of 



accelerator data. Their latest parton set ("MRS G") |L8[ is a parameterisa- 
tion that includes the recent HERA F2 data. The MRS fits supply individual 
parton distributions u v ,d v ,u s ,d s , s s ,c s ,b s which can be used to form F 2 and 



In their recent work |TJ| Frichter, McKay and Ralston have effectively 
fitted a two parameter (A, /i) solution of the structure function evolution equa- 
tions to the HERA F 2 ep data : 



F 2 ep (x, Q 2 ) = Ax-» Pqg ( 1 + fi,Q 



P gg (l + ^Q 2 ) 



x exp jln In ^\ In ^ P gg (l + Q 2 ) J (9) 

A is the QCD scale parameter (taken as 200MeV in the FMR result) and 
Pqgil + H, Q 2 ) and P gg (l + fi, Q 2 ) are the 1+/J moments of the quark-gluon and 
gluon-gluon splitting functions, evaluated at next to leading order |33|^ , |45[| . 
In order to obtain F% N , FMR make the assumption that the quark (gj) and 
anti-quark (qA distributions of the ith flavour are equal, and that 

Qi — <?? — u — d — s — 2c = 2b (10) 
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Substituting into F 2 P and F% N yields F 2 P = f qi (x, Q 2 ) and F% N = S qi {x, Q 2 ) 
from which we obtain : 

Ff = ^ (11) 



A least squares minimization to the 1992 and 1993 HERA F 2 ep data yields best 
fit parameters A = 0.008829 and fi = 0.3856. 



2.3 The total neutrino charged and neutral current cross sections 



To obtain the total cross sections I have integrated equation [I] using 
the MRS G and FMR parton distributions, for both the charged and neutral 
current forms of _F 2 and F$. 

The MRS G distributions cover the full range < x < 1 required, but 
the FMR result applies only at x ~ 0.2 or less. In order to evaluate the FMR 
cross section over the full x range, I have used the FMR result for x < 0.2 
and the MRS G result for x > 0.2. The MRS G parton distributions are 
valid down to x ~ 10~ 5 , which is adequate for the calculation of the cross 
sections in the energy range considered in this work (E v < 10 8 GeV). (Note 



that the double-logarithmic approximation |36| may be used to extrapolate 
the parton distributions to lower x for cross section calculations [^J35|j36]| 
where E v > 10 8 GeV.) 

Note also that I have combined a set of next-to-leading order (NLO) par- 
ton distributions (MRS G) calculated in the MS renormalization convention 
with the leading order (LO) form of the structure functions _F 2 and F$. The 
NLO expressions for F 2 and F3 (obtained by convolving the quark and gluon 
distributions with the Wilson coefficients j47|) will differ from the LO expres- 
sions by terms with coefficients as(Q 2 )/27r, where cts{Q 2 ) is the QCD coupling 
constant, which decreases as Q 2 increases. In the regions of high Q 2 (~ M^) 
important for the neutrino energies considered in this work as{Q 2 )/2ir has a 
value of ~ 0.02 and the resulting differences between the LO and NLO struc- 
ture functions, and hence the difference in the resulting cross sections, will be 
small (~ a few percent). Given the very large uncertainties in the astrophysical 
assumptions in this work, this is an acceptable approximation. 

The total neutrino/anti- neutrino charged/neutral current cross sections 
obtained by using the FMR and MRS G parton distributions are shown in 
figure [l], along with the U B— " neutrino charged current estimate by Reno |36 



Above 10 5 GeV neutrino and anti-neutrino cross sections are equal and the 
FMR cross sections are roughly 1.5 times bigger than the MRS G predictions 
and 2 times bigger than the Reno B— prediction. The recent calculations of 
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Gandhi et al [JIB] , using the CTEQ3 parton distributions p6| , yield a neutrino 
charged current cross section lower than using MRS G by about 7% at 10 3 
GeV, with difference rising to 23% at 10 8 GeV. The CTEQ3 cross section is 
bigger than the Reno B— cross section by 1-10% in the same energy range. 




10° 10 2 10 4 10 6 10 8 

E v (GeV) 

Fig. 1. Total v and v cross sections calculated using recent parton distributions. At 
low energy the curves represent (in decreasing order of cross section) v - charged 
current, v - charged current, v - neutral current and v - neutral current. At high 
energy, neutrino and anti-neutrino cross sections are equal. 



3 Astrophysical neutrino fluxes 



The reported observations [ P5| , ^S| , pD|pI| ] of UHE 7-rays from binary X- 
ray systems in the early 1980s led to predictions of neutrino fluxes from such 
objects. The assumption was that protons accelerated in the vicinity of the 
compact object would interact with other matter in the system to give both 
neutral and charged pions, the neutral pions decaying to produce the ob- 
served 7-rays and the charged pions producing a neutrino flux. Calculations 
were made p0| , ^4| , p2| , p3l , ^1 of the expected neutrino flux by scaling the models 
to the observed 7-ray flux. However the non-confirmation of the 7-ray obser- 
vations by much larger and more sensitive air shower arrays such as CASA 
| 55] , [56| , |57| , |58| , |59| has led to upper limits on the 7-ray fluxes that are orders of 
magnitude lower than the original detection claims, dampening expectation 
of observable neutrino fluxes from binary X-ray systems. 
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Fig. 2. Diffuse isotropic neutrino fluxes from the sum of all active galactic nuclei 
predicted by various models. The angle dependent neutrino flux produced from 
cosmic ray interactions in the earth's atmosphere is also shown for horizontal and 
vertical directions. The isotropic neutrino flux produced from prompt decays of 
charmed mesons in the atmosphere is also shown. 

Attention in recent times has focussed on the production of neutrinos in 
active galactic nuclei, where particle acceleration may be occuring at accre- 
tion shocks in the vicinity of massive black holes. Stecker, Done, Salamon and 
Sommers (SDSS) calculated the neutrino flux resulting from interactions 
of protons with energy above the threshold energy for photoproduction on UV 
photons (p7 — > A — > nn + ). Szabo and Protheroe (SP) included all the 
subsequent interactions of the protons after the initial photoproduction. Lu- 
minosity functions (derived from X-ray and gamma-ray measurements 
- describing the luminosity of AGN as a function of redshift) and the relation- 
ship between the neutrino and X-ray and gamma-ray outputs in a given AGN 
model were used to calculate the neutrino output from the sum of all AGN 
in the universe. More recently Stecker and Salamon || revised their original 
model and calculated diffuse neutrino backgrounds for quasar cores and blazar 
jets. 



Protheroe [|I7[] has calculated the neutrino and gamma-ray fluxes from 
proton acceleration in 'blobs ' of matter in AGN jets. Two major production 
mechanisms were considered. Accelerated protons may leave the blob and 
interact with the radiation field of the accretion disk (p7 interactions), or 
interact with each other or with other matter in the vicinity (pp interactions). 
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The observed time variability of gamma-rays from AGN such as MKR42 1 place 
constraints on the relative contribution of each mechanism. The pp interactions 
have a long characteristic time scale and therefore cannot produce variability of 
the order of a day. The py contribution, however, can vary rapidly and must be 
responsible for the time variation. To produce an intensity change of a factor of 
2 over a short time scale, the pp interaction can contribute no more than about 
50% to the total output. The pp interactions produce the most neutrinos, so 
the maximum allowable neutrino flux comes from equal contributions of pp 
and p7 and the minimum flux from 100% jry. The luminosity function W\ 



derived from the EGRET survey and the results from the SAS-2 experiment 



63fl have been used to produce a diffuse neutrino background estimate. 



Figure |2| shows the resulting neutrino fluxes from a number of different 
models. Note that the fluxes are multiplied by E 2 to reduce the range of the 
plot. Curves labelled 'SP' (dot-dashed lines) are predictions from the earlier 
Szabo and Protheroe models. 'SDSS92 ' is the Stecker et alpry flux, while 'SS95' 
is the sum of the quasar core and blazar jet contributions in the Stecker and 
Salamon model (dashed lines). The new Protheroe model is shown in solid lines 
for the limiting cases, the minimum expectation coming from pj interactions 
only and the maximum from equal contributions from pp and pj interactions. 

The major backgrounds to searches for AGN fluxes come from the decay 
of kaons, pions and muons produced from the interactions of cosmic rays in 
the earth's atmosphere. These fluxes show an angular dependence; in the hor- 
izontal direction the fluxes at the surface are greatest as the kaons, pions and 
muons traverse more atmosphere and have more time to decay. The results of 
Lipari |M| are shown. Another potential background comes from the prompt 



decay of charmed particles produced in cosmic ray interactions in the atmo- 
sphere. The expected neutrino fluxes should have a flatter energy spectrum 
and not show an angular dependence as the particles mostly decay before 
they can interact. Zas, Halzen and Vazquez ]13|| have calculated the expected 



neutrino fluxes from charmed meson decay under various assumptions of the 
charm production cross section and have computed muon rates in downward 
looking detectors. Gaisser, Halzen and Stanev [|TJ| conclude that model B is an 
upper limit to the neutrino fluxes in the region E u > 100 TeV. However, model 
D predicts higher fluxes at lower neutrino energies and gives overall the high- 
est muon rates in downward looking detectors of the two cases. I therefore use 
model D to predict the upper limit on the muon rate from charm production. 
As a lower limit, I take the prediction of Thunman, Ingelman and Gondolo 



[ 25 1 which gives neutrino fluxes nearly 100 times smaller than the ZHV model 
D. It is clear that there is a large uncertainty in the potential contribution of 
charmed meson decay to the neutrino induced muon fluxes. The implications 
of this on the detectability of the AGN fluxes will be addressed in the next 
section. 
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4 Neutrino induced muon rates in large detectors 



4-1 The neutrino interaction Monte Carlo 



Cerenkov detectors (DUMAND, AMANDA, NESTOR, Lake Baikal) de- 
tect upward going muons from charged current interactions of neutrinos in 
the earth. The muons can be produced many kilometres from the detector 
and still survive to be detected via their Cerenkov emissions in water or ice. 
Calculations of the expected muon fluxes from AGN |T0| , [TTl , p!2| , p!3| , p!4l have been 
made using various parton distributions and muon energy loss assumptions. In 
their original cross section paper ]19] , Frichter, McKay and Ralston calculated 
the rates of charged lepton production in a cubic kilometre volume of ice and 
noted that despite the increased attenuation with their new cross section, the 
increased interaction probability more than compensated for this, resulting 
in increased lepton production. In later work jTJ] , they calculated the specific 



rate expectations for a radio receiver in Antarctic ice, detecting radio Cerenkov 
radiation from electrons. The highest of the Szabo and Protheroe fluxes |J 
and the Stecker et al flux |J were used, the results suggesting these fluxes 
would be readily detectable with a single antenna buried at a depth of 600 
metres. Zas, Halzen and Vazquez |13| calculated the detection rates of neutrino 



induced horizontal air showers and underground muons, again for SDSS and 
SP fluxes. These calculations included the expected rates from charm induced 
neutrinos. The cross sections were calculated with the KMRSB-5 [^3] parton 



distributions which give total cross sections of about the size of the Reno B— 
estimate. Most recently, Gandhi, Quigg, Reno and Sarcevic [T(| (GQRS), have 
evaluated the cross sections for a variety of parton distributions and have then 



used the CTEQ3 parton distributions |26] to estimate muon rates from astro- 



physical sources. Due to the relative differences in the final cross sections, the 
CTEQ3 partons will yield muon rates closer to those using Reno B— than 
MRS G. 

The calculation of muon fluxes induced by neutrino interactions in the 
earth is complicated by neutrinos undergoing neutral current interactions in 
the earth (which reduce their energies but do not remove them from the beam) 
before they finally interact to produce a muon. The final number of neutrinos 
in a given energy bin after passage through the earth is reduced by both 
charged and neutral current interactions, but some of the total loss is offset 
by originally higher energy neutrinos having moved down in energy due to 
neutral current interactions. 

An effective total cross section can be calculated, which is dependent 
on the original source spectrum. This approach was followed by Berezinsky 
et al |J5| where the total cross section was taken as the sum of neutral and 



10 



charged current cross sections, with a correction term included to account for 
the source dependent neutral current neutrino regeneration effect. 



As an alternative approach to the neutral current effect, I have developed 
a Monte Carlo simulation [66| to model the passage of the neutrinos through 
the earth, taking into account the relative likelihood of neutral and charged 
current interactions, and selecting the final neutrino or muon energy from 
the energy dependent y distributions. A simple weighting system was devised 
(and generalized to account for neutrinos that undergo none, one, two or 
more neutral current scatters before a charged current interaction) to keep 
the computing time reasonable. Neutrinos and anti-neutrinos were treated 
separately using the appropriate cross sections. The column density of nucleons 
to be traversed by a neutrino as a function of nadir angle is calculated using 
the Preliminary Reference Earth Model |)7| , which describes how the density 
of the earth varies with distance from the centre. The final energy of a muon 
reaching the detector is determined using the muon propagation code of Lipari 
and Stanev The muon energy losses due to bremsstrahlung p5fl , e + e~ pair 
production |70] and photonuclear interactions [[71]] are treated stochastically 
in order to give the correct final fluctuations in muon ranges. Ionization losses 
are also taken into account. Only muons which are produced within the final 
tens of kilometres from the detector will actually survive to the detector, so 
for these calculations I use "standard rock" (Z = 11, A = 22, p = 2.65 g cm" 3 ) 
for the propagation. 



4-2 Integral neutrino induced muon rates 



I have calculated the expected muon rates using the cross sections Reno 
B-, FMR and MRS G resulting from the parton distributions described in 
section |2.2| which are derived from the latest accelerator structure function 
data. The higher cross sections result in greater attenuation of neutrinos within 
the earth, but this effect is offset by a greater probability of muon production 
by the surviving neutrinos in the final kilometres of rock before a detector, 
leading to greater expected muon rates. It is important to remember that the 
effective area of a detector will have an energy and arrival angle dependence 
and that the overall detection rate will depend upon the energy and angular 
spectrum of muons incident upon the detector. For example, the effective area 
for muon detection (averaged over arrival direction) [[72] by the DUMAND- 
II detector (20000m 2 geometric area) varies from about 5000m 2 at 10 GeV 
(the array does not trigger on all muons) up to 20000m 2 at 5 TeV and goes 
up to 60000m 2 at 10 7 GeV (the array triggers on muons that pass outside 
the detector volume). The muon rates calculated here assuming a spherical 
detector with a constant 20000m 2 effective area for all arrival directions and 
all muon energies will therefore be approximate lower bounds on the numbers 
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of muons detected for muons above about 1 TeV (near the energy at which 
the effective area equals the geometric area). Due to the increase in effective 
area at higher energies, the muon rates for flatter spectra will be enhanced 
over those of steeper spectra compared to the numbers presented here which 
are calculated for an energy independent effective area. Keeping this in mind, 
we examine the predicted muon rates induced by AGN neutrinos. 

The integral muon rates expected in a downward looking detector (27rsr 
field of view) are shown in figure |3| for the three different cross sections and nine 
different neutrino spectra of figure The predicted muon fluxes span several 
orders of magnitude. The SP94 flux exceeds the atmospheric background for 
a muon energy cut of a few GeV. At the other extreme, the P96p7 does not 
exceed the atmospheric background until an energy of around 10 TeV. The 
wide variation in the expected number of muons from charm induced neutrinos 
is evident. The TIG neutrino flux induces a very low rate of muons, around 
1/10 of the lowest AGN flux (P96p7), and should not pose a background 
problem at any muon energy cut. However, the ZHV D neutrino flux results 
in a muon rate exceeding that of the SDDS92 flux for muon energies up to 
~400 GeV, and roughly equal to that of the conventional atmospheric and 
P96p7 fluxes at a muon energy cut of 10 TeV. This great uncertainty suggests 
that there would be difficulties in identifying the origins of any observed muons 
should the lowest AGN flux be correct. 



The results presented here are not directly comparable to those of Gandhi 
et al\Wli, as the neutrino source spectra used in both cases are not identical. 
GQRS made a broken power law approximation to the SP94 (b=l) neutrino 
flux; this yields muon rates less than the SP94 curve in figure ^, which comes 
from using the highest of the SP94 fluxes. GQRS also calculated muon rates 
for the SS95 neutrino flux, but only for the quasar core component, whereas 
I have used the sum of quasar core and blazar jet components. Also, GQRS 
treat neutral currents by taking two cross sections: the first the sum of charged 
and neutral current cross sections, which gives a lower limit to the muon rate; 
the second the charged current cross section alone, which will give an upper 
limit to the muon rate. To check the consistency of the two sets of results, I 
have used the forms of the neutrino fluxes as implemented by GQRS with the 
MRS G and Reno B— cross sections and find that the muon rates obtained 
are consistent with the differences in cross sections in the two sets of work. 



4-3 Limits from the Frejus experiment 



The SP94 and SP92max fluxes have already been excluded by an analysis 
of the energy distribution of horizontal neutrino-induced muons in the Frejus 
experiment [75,73|. The Frejus detector was a fine grain tracking calorime- 
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ter operated deep underground, with the ability to accurately determine the 
energy of the through going muons from the energy deposited from electro- 
magnetic showering. At near horizontal angles the background atmospheric 
muon flux is sufficiently suppressed by the rock overburden to allow a mea- 
surement of the rate of atmospheric and AGN induced muons. The number 
of muons (producing an observed energy loss in the detector greater than the 
maximum observed energy loss) expected from each AGN spectrum has been 



calculated [|T^,[73|,[74].|75| taking into account the rock thickness, muon prop- 
agation and the increasing efficiency of the detector with increasing muon 
energy. The high fluxes SP94 and SP92max predict more muons than the 90% 
confidence level upper limit of 2.3 muons and are therefore excluded by this 
experiment. All the other fluxes considered predict less than 2.3 muons and 
are therefore not excluded by the Frejus result. 
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Fig. 3. Integral neutrino- induced muon rates in downward looking detectors as 
a function of neutrino source spectrum and parton distribution used in the cross 
section estimate. 



4-4 Effects of the higher neutrino cross sections 



The angular distributions of the muon fluxes for muon energies above 
10 3 GeV and 10 4 GeV are shown in figure [|for a collecting area of 20000 m 2 , 
which corresponds to that of the proposed nine string DUMAND-II array. The 
increases in the overall muon rates predicted by the FMR cross section are 
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not uniform over arrival direction. It is clear that most of the increases come 
from the highest nadir angles (muons coming from angles to ~30 degrees 
down from the horizon) where the thickness of the earth traversed by the neu- 
trinos is smaller and attenuation less important while the likelihood of muon 
production near the detector is greater. The rate of directly upgoing muons 
is very similar for all three cross sections considered - the increased rate of 
muon production in the final kilometres of rock is balanced by increased neu- 
trino attenuation in the earth. The increase in muon rates comes from arrival 
directions where surface or shallow detectors are most susceptible to noise 
contamination from downward going atmospheric muons mis-reconstructed as 
horizontal or upward going. However, deep underwater detectors which are 
better shielded from atmospheric muons will be sensitive to these increased 
near horizontal fluxes. For example, the DUMAND-II detector is expected to 
be sensitive to muons from downgoing neutrinos up to ~20 degrees above the 
horizon. 



4-5 Detectability of predicted AGN fluxes 

Here we consider only those neutrino predictions that have not been 
ruled out by the Frejus experiment. The total muons expected for nadir an- 
gles greater and less than 60 degrees as a function of muon energy cut and 
cross section for each neutrino source are summarized in table |1| It is evi- 
dent that the highest of these fluxes may be observable over the atmospheric 
background for a 100 GeV muon energy cut (~300-500 events per year above 
~2000 background) but that the smaller fluxes (10-100 events per year) would 
not. 

For a muon energy cut of 1 TeV, the atmospheric background is signif- 
icantly reduced and the fluxes P96p , y/pp, SP92min and SS95 Q+B are now 
greater than the background and should be observable. The lower SDSS92 flux 
would produce ~55-70 events per year above a 225 background and should 
be observable over several years but an uncertain contribution from charm 
induced neutrinos (~l-50 muons) would complicate matters. However figure 
[| shows that the charm induced muons have a flat angular distribution and 
this might aid in identification. The P96p7 is well below the background and 
given the charm uncertainty, would seem not to be detectable. 

Moving to a 10 TeV cut reduces the atmospheric background to ~5 per 
year, making all the fluxes readily observable, except for the lower bound of 
P96p7. This latter flux, the atmospheric background and the highest charm 
decay estimate (ZHV D) produce roughly equal numbers of muons. Given that 
the charm induced muon rate could actually be practically zero (as table p] 
shows), this would make a differentiation between charm induced and AGN 



14 



I I I I I I I I I I I I I 




0.0 0.2 0.4 0.6 0.8 1.0 

cosQ 

Fig. 4. Muon angular distributions for a 20000m 2 downward looking detector em- 
ploying a muon energy cuts of 10 3 and 10 4 GeV, for neutrino fluxes not excluded 
by the Frejus experiment. For clarity, only the FMR cross section results are shown 
for the smaller fluxes. 
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Table 1 

Integral muon rates in a 20000m 2 downward looking detector for nadir angles 0—60° 
(most upgoing) and 60 — 90° (nearer horizontal) for various neutrino spectra, cross 
sections and minimum muon energies. 



Muon energy cut — > 


> 10 2 GeV 


> 10 3 GeV 


Ef, > 10 4 GeV 


Nadir 


angle — > 


9 > 60° 


6 < 60° 


9 > 60° 


9 < 60° 


9 > 60° 


9 < 60° 




Atmos 


1421 


744 


157 


65 


4.8 


1.2 




SDSS 


68 


16 


58 


13 


37 


7.0 




SP92min 


315 


200 


215 


123 


83 


34 


FMR 


SS 95 Q+B 


258 


109 


200 


75 


105 


28 




P 96 P7/pp 


483 


358 


303 


206 


86 


43 




P 96 p7 


10.5 


1.5 


9.1 


1.2 


6.3 


0.7 




Charm D 


52 


43 


28 


21 


5.1 


2.9 




Charm TIG 


0.9 


0.8 


0.4 


0.3 


0.06 


0.03 




Atmos 


1394 


767 


158 


67 


4.1 


1.1 




SDSS 


55 


17 


46 


14 


29 


8.2 




SP92min 


272 


193 


182 


117 


65 


33 


MRS G 


SS 95 Q+B 


214 


108 


164 


76 


85 


30 




P 96 P7/pp 


434 


343 


265 


196 


69 


41 




P 96 p7 


9.4 


1.8 


7.9 


1.5 


5.5 


0.9 




Charm D 


49 


43 


25 


21 


4.2 


2.7 




Charm TIG 


0.9 


0.8 


0.4 


0.3 


0.05 


0.03 




Atmos 


1284 


710 


145 


63 


3.6 


1.1 




SDSS 


48 


18 


40 


15 


26 


8.6 




SP92min 


244 


181 


161 


111 


58 


32 


Reno B- 


SS 95 Q+B 


189 


105 


144 


74 


74 


31 




P 96 P7/pp 


393 


320 


239 


184 


61 


39 




P 96 p7 


8.0 


1.9 


7.0 


1.6 


4.9 


1.0 




Charm D 


46 


39 


24 


18 


3.4 


2.4 




Charm TIG 


0.8 


0.7 


0.4 


0.3 


0.04 


0.03 



16 



induced muon fluxes difficult, if only a small excess above the expected con- 
ventional atmospheric rate was seen. One could not simply do a counting ex- 
periment as the excess above the conventional atmospheric background could 
come from either of two sources. An examination of the angular distributions 
or differential energy spectra of the detected muons would be needed. 

The P96p7, Charm D and conventional atmospheric fluxes produce dif- 
ferent angular distributions, shown in figure [5]. The shape of the atmospheric 
neutrino induced muon curve reflects primarily the angular distribution of 
the source neutrinos. The isotropic charm-induced neutrinos produce a flatter 
angular distribution; but with muons resulting from higher energy neutrinos 
the angular shape shows evidence of some neutrino absorption. The muons 
induced by the isotropic P96pj flux show a strong angular dependence due to 
contributions from much higher neutrino energies. The three angular distri- 
butions are quite different for nadir angles greater than 60° (cos 6* < 0.5). A 
detector located deep enough such that atmospheric muons are not a problem 
should be sensitive to these differences, provided enough muons were measured 
to reveal the angular shape (requiring many years exposure for a 20000 m 2 
detector or a much larger detector). 

Surface or shallow detectors are affected by misreconstruction of down- 
ward muons, which restricts their acceptance aperture. Figure |5| shows that for 
nadir angles less than 60° (cos# > 0.5) the angular distributions of all three 
spectra are the same shape (fairly flat). Thus, even using a very large detec- 
tor/long exposure time but with restricted aperture, the angular distribution 
alone is not sufficient to determine how much of a small excess of muons was 
due to AGN, because of the large uncertainty in the charm induced neutrino 
flux. 

Measuring the energy spectrum of the observed muons may allow a dif- 
ferentiation between source spectra. The P96/ry and Charm D fluxes give equal 
numbers of muons above 10 TeV; however ~95% of the Charm D muons are 
in the energy range 10-100 TeV. The P96py muons are split roughly equally 
between the range 10-100 TeV and the region above 100 TeV. A comparison 
of the excesses in each of these energy regions may aid identification. However, 
we are dealing with very low count rates where statistical fluctuations and the 
uncertainty in the conventional atmospheric neutrino flux will also play a role. 

As we have just seen, determining the origin of a small excess of muons 
above the conventional atmospheric expectation relies on looking for angu- 
lar or energy distribution characteristics. The P96p7 and Charm D spectra 
produce sufficiently different muon distributions to allow them to be distin- 
guished. The integral muon energy spectrum (figure ||) for the P96p7/pp flux 
is similar to the Charm D muon spectrum, although it produces an absolute 
level of muons about a factor of 10 bigger. Also the angular distributions for 
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the P96p~//pp flux have near the same slopes as the Charm D angular distribu- 
tions. This shows that the higher the contribution from pp interactions to the 
diffuse AGN flux, the more the muon energy and angular distributions become 
similar to those from the charm induced neutrinos. An AGN spectrum made 
up of only 10% pp and 90% p-y contributions produces a differential muon 
spectrum with ~85% of the muons (above 10 TeV) in the energy range 10-100 
TeV, and an absolute level only a few times bigger than the Charm D muon 
spectrum. This shows that a small observed muon excess showing angular and 
energy distribution characteristics typical of the charm induced muon spectra 
could actually be due to a combination of an AGN spectrum with a modest 
pp contribution with a low overall flux level (of order of the P96j»7 flux given 
here) and a charm spectrum lower than the Charm D spectrum considered 
here. 

In this discussion I have considered models which produce low numbers 
of muons in large detectors. Clearly, there will be unambiguous signatures of 
AGN fluxes if the more optimistic fluxes are correct. Excesses well above those 
predicted by the Charm D flux will be clear evidence of an extra terrestrial 
origin. The P96p7 flux, although of the same level as the Charm D flux, has 
distinctive characteristics (flatter muon energy spectrum and steeper angular 
distribution) that set it apart from the charm induced muons. However, AGN 
spectra with only modest pp contributions produce muon distributions with 
similar characteristics to the charm induced muons. Interpreting a small ob- 
served excess of muons above the conventional atmospheric expectation will 
require a better understanding of the production of neutrinos from the prompt 
decay of charmed particles in the atmosphere. 



5 Conclusions 

In this work I have calculated the expected AGN neutrino induced muon 
rates in large detectors and have compared them to the backgrounds expected 
from atmospheric neutrinos (produced by the decay of pions, kaons, muons 
and the prompt decay of charmed mesons). A Monte Carlo simulation has been 
used which correctly accounts for the effects of neutral current scattering and 
uses cross sections calculated with the FMR and MRS G parton distributions, 
which were derived from recent accelerator data. These higher cross sections 
result in greater muon rates due to a greater probability of muon production 
in the final kilometres before a detector, but for incident neutrino directions 
in the 120 degree aperture about the nadir this effect is largely offset by 
increased neutrino absorption. The increases in muon rates come from nadir 
angles greater than 60 degrees, the region where surface or shallow detectors 
are most susceptible to atmospheric muon contamination. The very deepest 
detectors will be able to observe these increased fluxes. 



18 




0.0 0.2 0.4 0.6 0.8 1.0 

cosd 



Fig. 5. Muon angular distributions for a 20000m 2 downward looking detector em- 
ploying a muon energy cut of 10 4 GeV. The curve labelled Charm D is an upper 
estimate of the muons from the prompt decay of charmed mesons into neutrinos in 
the atmosphere and could be up to two orders of magnitude smaller. 

The lowest neutrino flux considered, due to p'-f interactions only in the 
Protheroe AGN model, would produce roughly 6 muons per year above 10 TeV 
in a 20000 m 2 detector, which is about the same as that expected from the 
conventional atmospheric sources and the same as expected from the highest 
estimates from charmed meson decay. The lowest neutrino induced muon flux 
due to charmed meson decay gives practically negligible muon rates, which 
suggests that telling these sources apart may be difficult. However, the P96p7 
AGN flux produces muons with angular and energy characteristics that would 
allow it to be distinguished from the charm and conventional atmospheric 
backgrounds. On the other hand, an AGN flux with around 10% or more 
contribution from pp interactions produces muon angular and energy distri- 
butions similar to those of the charm induced muons. An observation of muons 
seemingly consistent with the level of the Charm D flux could actually be due 
to an AGN spectrum with a modest pp contribution and an overall flux level 
around 1/10 th of the P96pj/pp flux, in combination with a charm induced 
flux consistent with the TIG model. A better understanding of the charm pro- 
duction mechanism in the atmosphere will then be required to interpret such 
an observation of a small number of muons above the conventional atmospheric 
background. 
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This discussion has centred around a possible 'worst case' scenario (low 
AGN fluxes and uncertain charm fluxes). The larger fluxes considered in this 
work would be readily observable in a 20000 m 2 detector, using energy cuts of 
around 1-10 TeV. The planned deployments or extensions of the DUMAND, 
AMANDA, NESTOR and Lake Baikal experiments should herald the birth 
of observational extra-terrestrial neutrino astronomy, if the more optimistic 
AGN models and neutrino fluxes considered in this work are near to correct. 
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